Alternatives and similar repositories for magikarp:

Users that are interested in magikarp are comparing it to the libraries listed below

• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆164Updated 3 weeks ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆82Updated 3 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆119Updated this week
• da03 / Internalize_CoT_Step_by_Step
  ☆135Updated 3 months ago
• google-deepmind / mishax
  ☆115Updated this week
• andyrdt / refusal_direction
  Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".
  ☆153Updated 3 months ago
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆105Updated last year
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆247Updated 6 months ago
• SALT-NLP / demonstrated-feedback
  ☆115Updated 3 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆206Updated 2 months ago
• EleutherAI / sae-auto-interp
  ☆135Updated this week
• hadasah / btm
  ☆72Updated 8 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆96Updated 9 months ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆118Updated last month
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆170Updated last week
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆150Updated 10 months ago
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆126Updated 2 months ago
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆52Updated last week
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆153Updated last month
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆97Updated 10 months ago
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆78Updated last month
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated 11 months ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆233Updated 2 months ago
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning"
  ☆97Updated 6 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆141Updated 9 months ago
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆64Updated 5 months ago
• allenai / bff
  ☆38Updated 9 months ago
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆184Updated 5 months ago
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆81Updated 2 months ago
• SalesforceAIResearch / LaTRO
  ☆89Updated this week