Alternatives and similar repositories for magikarp

Users that are interested in magikarp are comparing it to the libraries listed below

• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆155Updated last year
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆204Updated 3 weeks ago
• GraySwanAI / circuit-breakers
  Improving Alignment and Robustness with Circuit Breakers
  ☆208Updated 8 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆87Updated 6 months ago
• normster / llm_rules
  RuLES: a benchmark for evaluating rule-following in language models
  ☆224Updated 3 months ago
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆103Updated 3 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆223Updated 7 months ago
• voidism / Lookback-Lens
  Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"
  ☆126Updated 9 months ago
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆76Updated last year
• google-deepmind / mishax
  ☆131Updated 2 months ago
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆172Updated 4 months ago
• andyrdt / refusal_direction
  Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".
  ☆225Updated 8 months ago
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆215Updated last month
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆181Updated this week
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆92Updated this week
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆79Updated 3 months ago
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]
  ☆106Updated 3 months ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆242Updated 6 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆128Updated 4 months ago
• architsharma97 / dpo-rlaif
  ☆97Updated 11 months ago
• princeton-nlp / HELMET
  The HELMET Benchmark
  ☆149Updated last month
• SalesforceAIResearch / LaTRO
  ☆114Updated 3 months ago
• da03 / Internalize_CoT_Step_by_Step
  ☆174Updated last month
• SALT-NLP / demonstrated-feedback
  ☆120Updated 8 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆201Updated last month
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆161Updated 3 weeks ago
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆75Updated 6 months ago
• ScalerLab / JudgeBench
  ☆81Updated 7 months ago
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆193Updated 6 months ago
• llm-merging / LLM-Merging
  LLM-Merging: Building LLMs Efficiently through Merging
  ☆197Updated 8 months ago