Alternatives and similar repositories for SmallBench

Users that are interested in SmallBench are comparing it to the libraries listed below

• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆59Updated last month
• arcee-ai / DAM
  ☆55Updated last year
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆34Updated 7 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆93Updated last year
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated last year
• yueqis / API-Based-Agent
  ☆62Updated 5 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆189Updated 8 months ago
• brendanhogan / picoDeepResearch
  ☆68Updated 6 months ago
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆66Updated 11 months ago
• Columbia-NLP-Lab / PAPILLON
  Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles
  ☆60Updated 6 months ago
• rawsh / mirrorllm
  various experiments for scaling inference time compute with small reasoning models
  ☆17Updated 10 months ago
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆110Updated 11 months ago
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆93Updated 2 months ago
• allenai / infinigram-api
  ☆87Updated last week
• Alex-Gurung / ReasoningNCP
  Official repo for Learning to Reason for Long-Form Story Generation
  ☆72Updated 7 months ago
• brendanhogan / completion_tree_view
  ☆15Updated 7 months ago
• Danau5tin / calculator_agent_rl
  Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.
  ☆60Updated 6 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆107Updated 8 months ago
• collinear-ai / spider
  Streamline on-policy/off-policy distillation workflows in a few lines of code
  ☆65Updated last week
• PrimeIntellect-ai / genesys
  ☆136Updated 8 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆90Updated last year
• ScalingIntelligence / codemonkeys
  ☆59Updated 10 months ago
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆30Updated 11 months ago
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated last month
• matthewrenze / jhu-concise-cot
  The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models
  ☆22Updated last year
• huggingface / wikirace-llms
  ☆25Updated 6 months ago
• SalesforceAIResearch / LaTRO
  ☆124Updated 9 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated 9 months ago
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆173Updated 10 months ago