Alternatives and similar repositories for magikarp

Users that are interested in magikarp are comparing it to the libraries listed below

• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆161Updated last year
• normster / llm_rules
  RuLES: a benchmark for evaluating rule-following in language models
  ☆232Updated 6 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆137Updated 8 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆88Updated 11 months ago
• architsharma97 / dpo-rlaif
  ☆100Updated last year
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆90Updated 9 months ago
• google-deepmind / mishax
  ☆142Updated last week
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆245Updated 10 months ago
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆92Updated 10 months ago
• JacobPfau / fillerTokens
  ☆72Updated last year
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆271Updated last year
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆241Updated 10 months ago
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆128Updated 2 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆99Updated last year
• voidism / Lookback-Lens
  Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"
  ☆130Updated last year
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆248Updated last year
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆309Updated last year
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆75Updated last year
• allenai / infinigram-api
  ☆81Updated 2 weeks ago
• hadasah / btm
  ☆75Updated last year
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆150Updated 7 months ago
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆107Updated last year
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆229Updated 2 months ago
• SALT-NLP / demonstrated-feedback
  ☆127Updated 11 months ago
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆91Updated last week
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆245Updated 5 months ago
• sail-sg / sailcraft
  🚢 Data Toolkit for Sailor Language Models
  ☆94Updated 6 months ago
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆211Updated 2 weeks ago
• da03 / Internalize_CoT_Step_by_Step
  ☆190Updated 5 months ago
• imoneoi / multipack
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆201Updated last year