neulab / gemini-benchmark

Related projects ⓘ

Alternatives and complementary repositories for gemini-benchmark

• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆146Updated 3 weeks ago
• SALT-NLP / demonstrated-feedback
  ☆112Updated last month
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆108Updated 2 months ago
• google / sycophancy-intervention
  Scripts for generating synthetic finetuning data for reducing sycophancy.
  ☆107Updated last year
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆147Updated 8 months ago
• WHGTyen / BIG-Bench-Mistake
  A dataset of LLM-generated chain-of-thought steps annotated with mistake location.
  ☆73Updated 3 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆198Updated 3 weeks ago
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆124Updated 3 weeks ago
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆115Updated 2 weeks ago
• wenhuchen / TheoremQA
  The dataset and code for paper: TheoremQA: A Theorem-driven Question Answering dataset
  ☆154Updated 7 months ago
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning"
  ☆91Updated 4 months ago
• openai / safety-rbr-code-and-data
  Code and example data for the paper: Rule Based Rewards for Language Model Safety
  ☆158Updated 4 months ago
• GAIR-NLP / OlympicArena
  This is the official repository of the paper "OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI"
  ☆86Updated last month
• JacobPfau / fillerTokens
  ☆49Updated 6 months ago
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆213Updated last year
• da03 / Internalize_CoT_Step_by_Step
  ☆103Updated last month
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆49Updated 9 months ago
• microsoft / rho
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆307Updated 7 months ago
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆109Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆72Updated 2 months ago
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆199Updated 6 months ago
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆155Updated 6 months ago
• reka-ai / reka-vibe-eval
  Multimodal language model benchmark, featuring challenging examples
  ☆149Updated 3 months ago
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆145Updated 2 weeks ago
• jakespringer / echo-embeddings
  ☆126Updated 7 months ago
• swj0419 / detect-pretrain-code
  This repository provides an original implementation of Detecting Pretraining Data from Large Language Models by *Weijia Shi, *Anirudh Aji…
  ☆208Updated last year
• Psycoy / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆224Updated 2 weeks ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆135Updated 7 months ago
• ruiqi-zhong / D5
  The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions
  ☆68Updated last year
• da03 / implicit_chain_of_thought
  ☆95Updated last week