Alternatives and similar repositories for magikarp:

Users that are interested in magikarp are comparing it to the libraries listed below

• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆84Updated 6 months ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆181Updated last week
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆125Updated 2 months ago
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆72Updated 7 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆83Updated 4 months ago
• da03 / Internalize_CoT_Step_by_Step
  ☆163Updated 3 weeks ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆233Updated 4 months ago
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆106Updated last year
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]
  ☆102Updated last month
• architsharma97 / dpo-rlaif
  ☆96Updated 9 months ago
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆300Updated last year
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆195Updated this week
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆148Updated 11 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆253Updated 8 months ago
• SalesforceAIResearch / LaTRO
  ☆111Updated last month
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆168Updated 2 months ago
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆62Updated last month
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆186Updated 7 months ago
• normster / llm_rules
  RuLES: a benchmark for evaluating rule-following in language models
  ☆220Updated last month
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆206Updated 3 weeks ago
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆111Updated last month
• voidism / Lookback-Lens
  Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"
  ☆119Updated 7 months ago
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆89Updated last year
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆183Updated this week
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆219Updated 5 months ago
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆85Updated 2 weeks ago
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆165Updated last week
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆125Updated last year
• GraySwanAI / circuit-breakers
  Improving Alignment and Robustness with Circuit Breakers
  ☆192Updated 6 months ago
• google-deepmind / mishax
  ☆124Updated last week