Alternatives and similar repositories for Middleware

Users that are interested in Middleware are comparing it to the libraries listed below

• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated last year
• neulab / data-agora
  [arXiv preprint] Official Repository for "Evaluating Language Models as Synthetic Data Generators"
  ☆33Updated 6 months ago
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆57Updated 6 months ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• wzhouad / context-faithful-llm
  Code and data for paper "Context-faithful Prompting for Large Language Models".
  ☆40Updated 2 years ago
• GAIR-NLP / MetaCritique
  Evaluate the Quality of Critique
  ☆35Updated last year
• Strong-AI-Lab / Logical-and-abstract-reasoning
  Evaluation on Logical Reasoning and Abstract Reasoning Challenges
  ☆27Updated 2 months ago
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆47Updated 5 months ago
• gersteinlab / Struc-Bench
  ☆53Updated 11 months ago
• OSU-NLP-Group / AttrScore
  Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"
  ☆56Updated last year
• dinobby / MAGDi
  The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…
  ☆34Updated last year
• allenai / super-benchmark
  ☆43Updated 2 months ago
• xxxiaol / QRData
  Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data
  ☆38Updated 4 months ago
• MLE-Dojo / MLE-Dojo
  ☆53Updated last week
• ZonglinY / MOOSE
  [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …
  ☆42Updated 7 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆57Updated 9 months ago
• oriyor / reasoning-on-cots
  Implementation of the paper: "Answering Questions by Meta-Reasoning over Multiple Chains of Thought"
  ☆95Updated last year
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 4 months ago
• belindal / ERASE
  Code and Data for "Language Modeling with Editable External Knowledge"
  ☆33Updated last year
• OSU-NLP-Group / In-Context-Reranking
  [ICLR'25] "Attention in Large Language Models Yields Efficient Zero-Shot Re-Rankers"
  ☆22Updated 2 months ago
• abhika-m / FAVA
  ☆71Updated last year
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples
  ☆95Updated 2 weeks ago
• orionw / FollowIR
  FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
  ☆44Updated 11 months ago
• Zayne-sprague / MuSR
  ☆44Updated 10 months ago
• jiangjiechen / auction-arena
  Source code for our paper: "Put Your Money Where Your Mouth Is: Evaluating Strategic Planning and Execution of LLM Agents in an Auction A…
  ☆45Updated last year
• scandukuri / assistant-gate
  ☆25Updated last year
• LuLuLuyi / LongHeads
  LongHeads: Multi-Head Attention is Secretly a Long Context Processor
  ☆29Updated last year
• du-nlp-lab / MLR-Copilot
  ☆65Updated 2 months ago
• SALT-NLP / collaborative-gym
  Framework and toolkits for building and evaluating collaborative agents that can work together with humans.
  ☆84Updated 2 months ago
• awslabs / rag-qa-arena
  ☆45Updated 10 months ago