Alternatives and similar repositories for magikarp:

Users that are interested in magikarp are comparing it to the libraries listed below

• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆221Updated 5 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆85Updated 6 months ago
• da03 / Internalize_CoT_Step_by_Step
  ☆166Updated last week
• SalesforceAIResearch / LaTRO
  ☆114Updated 2 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆127Updated 3 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆83Updated 4 months ago
• normster / llm_rules
  RuLES: a benchmark for evaluating rule-following in language models
  ☆221Updated 2 months ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆191Updated last month
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆187Updated 4 months ago
• voidism / Lookback-Lens
  Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"
  ☆120Updated 8 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆151Updated last year
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆64Updated 2 months ago
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆106Updated last year
• architsharma97 / dpo-rlaif
  ☆96Updated 9 months ago
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆165Updated 3 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆96Updated last year
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆188Updated 8 months ago
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆171Updated 3 months ago
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆218Updated last year
• google-deepmind / mishax
  ☆128Updated 3 weeks ago
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆72Updated 8 months ago
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]
  ☆105Updated 2 months ago
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆209Updated last week
• GraySwanAI / circuit-breakers
  Improving Alignment and Robustness with Circuit Breakers
  ☆197Updated 7 months ago
• princeton-nlp / HELMET
  The HELMET Benchmark
  ☆135Updated last week
• da03 / implicit_chain_of_thought
  ☆126Updated 5 months ago
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆125Updated last year
• openai / safety-rbr-code-and-data
  Code and example data for the paper: Rule Based Rewards for Language Model Safety
  ☆186Updated 9 months ago
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆108Updated last year
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆133Updated 5 months ago