InflectionAI / Inflection-Benchmarks

Related projects ⓘ

Alternatives and complementary repositories for Inflection-Benchmarks

• ScalingIntelligence / large_language_monkeys
  ☆55Updated last month
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆105Updated last year
• da03 / Internalize_CoT_Step_by_Step
  ☆103Updated last month
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆78Updated last month
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆76Updated 7 months ago
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆85Updated 8 months ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆48Updated 7 months ago
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆41Updated last month
• allenai / bff
  ☆38Updated 7 months ago
• JacobPfau / fillerTokens
  ☆49Updated 6 months ago
• scottlogic-alex / prm800k-denorm
  Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format
  ☆27Updated last year
• princeton-nlp / USACO
  Can Language Models Solve Olympiad Programming?
  ☆101Updated 3 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆94Updated 7 months ago
• NousResearch / StripedHyenaTrainer
  ☆57Updated 11 months ago
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆97Updated last year
• TristanThrush / i-am-a-strange-dataset
  Repository for "I am a Strange Dataset: Metalinguistic Tests for Language Models"
  ☆39Updated 10 months ago
• reka-ai / reka-vibe-eval
  Multimodal language model benchmark, featuring challenging examples
  ☆149Updated 3 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆46Updated 2 months ago
• ruiqi-zhong / D5
  The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions
  ☆68Updated last year
• CarperAI / treasure_trove
  ☆22Updated last year
• EleutherAI / semantic-memorization
  ☆46Updated last week
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆16Updated 3 weeks ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆44Updated 10 months ago
• WHGTyen / BIG-Bench-Mistake
  A dataset of LLM-generated chain-of-thought steps annotated with mistake location.
  ☆73Updated 3 months ago
• Zyphra / Zyda_processing
  ☆28Updated 5 months ago
• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆41Updated 10 months ago
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆199Updated 6 months ago
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆77Updated 8 months ago
• IBM / ModuleFormer
  ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…
  ☆216Updated 7 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year