Alternatives and similar repositories for diplobench

Users that are interested in diplobench are comparing it to the libraries listed below

• strangeloopcanon / LLMRank
  PageRank for LLMs
  ☆51Updated 2 months ago
• jerber / arc_agi
  ☆62Updated 3 months ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated 10 months ago
• normal-computing / extended-mind-transformers
  ☆124Updated last year
• vgel / logitloom
  explore token trajectory trees on instruct and base models
  ☆148Updated 5 months ago
• interstellarninja / MeeseeksAI
  A framework for orchestrating AI agents using a mermaid graph
  ☆77Updated last year
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆145Updated 8 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated last year
• lechmazur / nyt-connections
  Benchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words
  ☆156Updated 3 weeks ago
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated last month
• marketagents-ai / MarketAgents
  An agent orchestration framework for economic agents
  ☆105Updated 2 months ago
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆307Updated last month
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆298Updated 5 months ago
• simple-bench / SimpleBench
  ☆171Updated 10 months ago
• tom-doerr / dspy_nodes
  WIP - Allows you to create DSPy pipelines using ComfyUI
  ☆198Updated 11 months ago
• AnswerDotAI / fastdata
  ☆159Updated 11 months ago
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆92Updated last month
• Ziems / arbor
  A framework for optimizing DSPy programs with RL
  ☆273Updated this week
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆102Updated last year
• QuixiAI / kraken
  ☆67Updated last year
• doomslide / hyperobject
  Plotting (entropy, varentropy) for small LMs
  ☆98Updated 5 months ago
• centerforaisafety / emergent-values
  Code for "Utility Engineering: Analyzing and Controlling Emergent Value Systems in AIs"
  ☆81Updated 8 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• alexzhang13 / rlm
  Super basic implementation (gist-like) of RLMs with REPL environments.
  ☆242Updated 3 weeks ago
• dottxt-ai / demos
  ☆121Updated last month
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆91Updated 9 months ago
• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆88Updated this week
• epang080516 / arc_agi
  SoTA Approach for ARC-AGI 2
  ☆128Updated last month
• teknium1 / ShareGPT-Builder
  ☆116Updated 10 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆109Updated 8 months ago