simple-bench / SimpleBenchLinks
☆166Updated 9 months ago
Alternatives and similar repositories for SimpleBench
Users that are interested in SimpleBench are comparing it to the libraries listed below
Sorting:
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆450Updated last year
- Aidan Bench attempts to measure <big_model_smell> in LLMs.☆312Updated 3 months ago
- Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.☆228Updated 2 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆146Updated 7 months ago
- ⚖️ Awesome LLM Judges ⚖️☆130Updated 5 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆172Updated 8 months ago
- Coding problems used in aider's polyglot benchmark☆182Updated 9 months ago
- A benchmark for emotional intelligence in large language models☆365Updated last year
- Fast parallel LLM inference for MLX☆220Updated last year
- Testing baseline LLMs performance across various models☆311Updated last week
- Train your own SOTA deductive reasoning model☆107Updated 7 months ago
- SoTA Approach for ARC-AGI 2☆97Updated 3 weeks ago
- smolLM with Entropix sampler on pytorch☆150Updated 11 months ago
- smol models are fun too☆93Updated 10 months ago
- ☆135Updated 6 months ago
- Approximation of the Claude 3 tokenizer by inspecting generation stream☆140Updated last year
- A framework for optimizing DSPy programs with RL☆185Updated 2 weeks ago
- Just a bunch of benchmark logs for different LLMs☆119Updated last year
- ☆162Updated 2 months ago
- ☆123Updated last year
- DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.☆182Updated 4 months ago
- Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.☆53Updated 5 months ago
- ☆60Updated 2 months ago
- Long context evaluation for large language models☆222Updated 7 months ago
- Public repository containing METR's DVC pipeline for eval data analysis☆117Updated 6 months ago
- Official repository for "NoLiMa: Long-Context Evaluation Beyond Literal Matching"☆157Updated 2 months ago
- Inference-time scaling for LLMs-as-a-judge.☆300Updated last week
- ☆57Updated 8 months ago
- Function Calling Benchmark & Testing☆90Updated last year
- GRadient-INformed MoE☆264Updated last year