Alternatives and similar repositories for gemini-benchmark:

Users that are interested in gemini-benchmark are comparing it to the libraries listed below

• SALT-NLP / demonstrated-feedback
  ☆120Updated 7 months ago
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]
  ☆105Updated 2 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆221Updated 6 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆151Updated last year
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆160Updated last year
• WHGTyen / BIG-Bench-Mistake
  A dataset of LLM-generated chain-of-thought steps annotated with mistake location.
  ☆81Updated 8 months ago
• google / sycophancy-intervention
  Scripts for generating synthetic finetuning data for reducing sycophancy.
  ☆110Updated last year
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆192Updated 2 weeks ago
• sail-sg / sailcraft
  🚢 Data Toolkit for Sailor Language Models
  ☆90Updated 2 months ago
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆205Updated 11 months ago
• GAIR-NLP / AIME-Preview
  ☆62Updated last month
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆106Updated last year
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆219Updated last year
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆159Updated last year
• wenhuchen / TheoremQA
  The dataset and code for paper: TheoremQA: A Theorem-driven Question Answering dataset
  ☆157Updated last year
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆108Updated last year
• oriyor / reasoning-on-cots
  Implementation of the paper: "Answering Questions by Meta-Reasoning over Multiple Chains of Thought"
  ☆94Updated last year
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆134Updated 6 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆84Updated 5 months ago
• IBM / ModuleFormer
  ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…
  ☆220Updated last year
• architsharma97 / dpo-rlaif
  ☆97Updated 10 months ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆116Updated last year
• Edward-Sun / RECITE
  Code of ICLR paper: https://openreview.net/forum?id=-cqvvvb-NkI
  ☆94Updated 2 years ago
• akoksal / LongForm
  Reverse Instructions to generate instruction tuning data with corpus examples
  ☆209Updated last year
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆139Updated 6 months ago
• GAIR-NLP / OlympicArena
  [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI
  ☆101Updated 2 months ago
• princeton-nlp / LLMBar
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆124Updated 10 months ago
• kernelmachine / silo-lm
  SILO Language Models code repository
  ☆81Updated last year
• bigcode-project / astraios
  Astraios: Parameter-Efficient Instruction Tuning Code Language Models
  ☆57Updated last year
• princeton-nlp / HELMET
  The HELMET Benchmark
  ☆142Updated 3 weeks ago