Alternatives and similar repositories for magikarp

Users that are interested in magikarp are comparing it to the libraries listed below

• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆161Updated last year
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated last year
• allenai / bff
  ☆39Updated last year
• normster / llm_rules
  RuLES: a benchmark for evaluating rule-following in language models
  ☆234Updated 7 months ago
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆311Updated last year
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆213Updated last month
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆92Updated 10 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆273Updated last year
• JacobPfau / fillerTokens
  ☆72Updated last year
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆138Updated 8 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆90Updated 10 months ago
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆143Updated 11 months ago
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆107Updated 2 years ago
• google-deepmind / mishax
  ☆142Updated last month
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆216Updated 2 months ago
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆75Updated last year
• ScalerLab / JudgeBench
  ☆101Updated 11 months ago
• architsharma97 / dpo-rlaif
  ☆100Updated last year
• SalesforceAIResearch / LaTRO
  ☆123Updated 7 months ago
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆104Updated last year
• allenai / infinigram-api
  ☆80Updated this week
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆100Updated last year
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆250Updated 11 months ago
• lukasberglund / reversal_curse
  ☆295Updated last year
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆71Updated last year
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆247Updated last year
• msclar / formatspread
  Code accompanying "How I learned to start worrying about prompt formatting".
  ☆110Updated 4 months ago
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆230Updated 2 months ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆252Updated 3 months ago
• Aleph-Alpha-Research / scaling
  Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…
  ☆64Updated last week