Alternatives and similar repositories for Inflection-Benchmarks:

Users that are interested in Inflection-Benchmarks are comparing it to the libraries listed below

• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆84Updated 6 months ago
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆106Updated last year
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆86Updated 3 weeks ago
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆77Updated last year
• allenai / bff
  ☆38Updated 11 months ago
• scottlogic-alex / prm800k-denorm
  Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format
  ☆27Updated last year
• apple / ml-planner
  ☆48Updated last year
• ruiqi-zhong / D5
  The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions
  ☆69Updated 2 years ago
• vicksEmmanuel / latent-gemma
  ☆24Updated 3 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆83Updated 4 months ago
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆89Updated last year
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆96Updated last year
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆53Updated 4 months ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆47Updated last year
• CarperAI / treasure_trove
  ☆22Updated last year
• EleutherAI / semantic-memorization
  ☆44Updated 4 months ago
• NousResearch / StripedHyenaTrainer
  ☆60Updated last year
• ScalingIntelligence / large_language_monkeys
  ☆89Updated 6 months ago
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆187Updated 8 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 8 months ago
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆72Updated 7 months ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆82Updated last year
• benlipkin / probsem
  Probabilistic LLM evaluations. [CogSci2023; ACL2023]
  ☆73Updated 8 months ago
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated last year
• princeton-nlp / USACO
  Can Language Models Solve Olympiad Programming?
  ☆114Updated 3 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• reka-ai / reka-vibe-eval
  Multimodal language model benchmark, featuring challenging examples
  ☆163Updated 3 months ago
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆125Updated last year
• IBM / ModuleFormer
  ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…
  ☆217Updated last year