Alternatives and similar repositories for magikarp

Users that are interested in magikarp are comparing it to the libraries listed below

• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆170Updated last year
• normster / llm_rules
  RuLES: a benchmark for evaluating rule-following in language models
  ☆245Updated 10 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆142Updated 11 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆90Updated last year
• imoneoi / multipack
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆203Updated last year
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆316Updated 2 years ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆278Updated last year
• allenai / bff
  ☆38Updated last year
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆222Updated 2 weeks ago
• bminixhofer / tokenkit
  A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.
  ☆59Updated 5 months ago
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆93Updated last year
• google-deepmind / mishax
  ☆149Updated 3 months ago
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆248Updated last year
• SalesforceAIResearch / LaTRO
  ☆125Updated 10 months ago
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆108Updated 2 years ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆253Updated last year
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆233Updated 4 months ago
• TransluceAI / observatory
  A toolkit for describing model features and intervening on those features to steer behavior.
  ☆225Updated 3 weeks ago
• architsharma97 / dpo-rlaif
  ☆100Updated last year
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆312Updated last month
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆91Updated last year
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]
  ☆110Updated 10 months ago
• JacobPfau / fillerTokens
  ☆75Updated last year
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆100Updated last year
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆205Updated last year
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆71Updated last year
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆225Updated last year
• HazyResearch / TART
  TART: A plug-and-play Transformer module for task-agnostic reasoning
  ☆202Updated 2 years ago
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆127Updated 2 years ago
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆95Updated 3 months ago