Alternatives and similar repositories for Inflection-Benchmarks:

Users that are interested in Inflection-Benchmarks are comparing it to the libraries listed below

• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆105Updated last year
• NousResearch / StripedHyenaTrainer
  ☆60Updated last year
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆88Updated 11 months ago
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆77Updated 10 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆82Updated 4 months ago
• allenai / bff
  ☆38Updated 10 months ago
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆184Updated 6 months ago
• ruiqi-zhong / D5
  The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions
  ☆69Updated last year
• scottlogic-alex / prm800k-denorm
  Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format
  ☆27Updated last year
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆113Updated 5 months ago
• google / sycophancy-intervention
  Scripts for generating synthetic finetuning data for reducing sycophancy.
  ☆107Updated last year
• ScalingIntelligence / large_language_monkeys
  ☆82Updated 4 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆81Updated 11 months ago
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆65Updated 6 months ago
• IBM / ModuleFormer
  ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…
  ☆215Updated 10 months ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆52Updated 10 months ago
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆85Updated 9 months ago
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆204Updated 9 months ago
• EleutherAI / semantic-memorization
  ☆44Updated 3 months ago
• CarperAI / autocrit
  A repository for transformer critique learning and generation
  ☆88Updated last year
• reka-ai / reka-vibe-eval
  Multimodal language model benchmark, featuring challenging examples
  ☆158Updated 2 months ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆46Updated last year
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆78Updated 2 years ago
• CarperAI / treasure_trove
  ☆22Updated last year
• da03 / implicit_chain_of_thought
  ☆116Updated 3 months ago
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆48Updated 2 months ago
• princeton-nlp / USACO
  Can Language Models Solve Olympiad Programming?
  ☆110Updated last month
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆54Updated 5 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆82Updated 2 months ago